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The Center 



The misBion of the Center for Research on Elementary and Middle 
Schools is to produce useful knowledge about how elementary and mid-* 
die schools can foster growth in students' learning and development, 
to develop and evaluate practical methods for improving the effec-* 
tiveness of elementary and middle schools based on existing and new 
research findings, and to develop and evaluate specific stratiegies 
to help schools implement effective research-based school and class- 
room practices. 

The Center conducts its research in three program areas: (1) Ble** 
mentary Schools; (2) Middle Schools, and (3) School Improvement. 

Ibfi Elementary ^g^hfifil USSUSB 

This program works from a strong existing research base to 
develop, evaluate, and disseminate effective elementary school and 
classroom practices; synthesizes current knowledge; and analyzes 
survey and descriptive data to expand the knowledge base in effec- 
tive elementary education. 

lh£ Uiddlf .S£hfi^2l Program 

This program's research links current knowledge about early 
adolescence as a stage of human development to school organization 
and classroom policies and practices for effective middle schools. 
The major task is to establish a research base tp identify specific 
problem areas and promising practices in middle schools that, will 
contribute to effective policy decisions and the develo£»Qent of 
effective school and classroom practices. 

^Schfifil Improvement Program 

This program focuses on improving the organizational performance 
of schools in adopting and adapting innovations and developing 
school capacity for change. 



This report, prepared by the Elementary School Program, describes 
the first field-experimental evaluation of a comprehensive coopera- 
tive learning program for teaching reading and writing in elementary 
schools. 
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A Comprehensive Cooperative Learning Approach to 
Elementary ^Reading and Writing: 
Effects on Student Achievement 



Abstr$>ct 



This study evaluated a comprehensive cooperative learninr 
approach to elementary reading and writing instruction^ Cooperative 
Integrated Reading and Composition (CIRC). In CIRC, students worked 
in heterogeneous learning teams for all reading, language arts, and 
writing activities. In reading they worked with partners during 
followup times on partner reading, vocabulary, decoding, and spell- 
ing practice, and story grammar, prediction, and story summary 
activities based on basal stories. Students worked in teams on 
structured reading comprehension and language arts activities, and 
engaged in peer editing in writing^ A twelve-week experiment com- 
pared 11 grade 3-4 CIRC classes to 10 matched control classes. Ran- 
dom-effects nested ANOVA' s on adjusted posttests indicated signifi- 
cantly higher achievement in CIRC than control classes on 
standardized Reading Comprehension, Reading Vocabulary, Language 
Expression, and Spelling scales, and on ratings of Organization in 
writing samples. 
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Tptroductton 

Over the past fifteen years, a substantial body of research has 
established that when students work in four-member, heterogeneous 
learning groups and are rewarded based on the learning of all group 
members, students gain in academic achievement (Sharan, 1980; Slavin 
1983a, b). These cooperative learning methods have been studied in 
grades two through college, in urban, rural j. and suburban locations, 
and in such subjects as mathematics, social studies, and language 
arts. 

Early cooperative learning methods, such as those described by 
Aronson, Blaney, Stephan, Sikes & Snapp (1978), Johnson & Johnson 
(1975), Sharan and Sharan (1976), and Slavin (1983c) were designed 
primarily as supplements to traditional classroom activities and 
curricula, but recently comprehensive instructional programs based 
on cooperative activities have been developed. Among these are such 
programs as Finding Out/Descubrimiento, a discovery-oriented science 
and mathematics program (DeAvila & Duncan, 1984) , and Team Assisted 
Individualization, a mathematics program which combines cooperative 
learning and individualized instruction (Slavin, 1985). 

More than fifty high-quality field experiments involving dura- 
tions of at least four weeks have evaluated cooperative learning 
methods, and the findings consistently support the use of those 
which use specific group incentives (^uch as recognition or grades) 
based on the sum of the group members' individual learning perfor- 
mances, such as the group members' average quiz scores (Slavin 
1983a,b). 




However, research and development o£ cooperative learning methods 
has been conspicuously neglected in two of the most essential sub- 
jects in the elementary jschool curriculum; Reading- and writing. 
The reasons for this have to do with the nature of these subjects. 
Reading is typically taught using homogeneous reading groups (Hie- 
bertf 1983) r making problematic the use of the heterogeneous learn- 
ing groups central to all cooperative lear^^ing methods, and writing 
has been viewed as a personal, individual task. 

Although much research has established the positive effects of 
cooperative learning on learning of language mechanics skills (e.g., 
Slavin & Karweit, 1981), cooperative learning methods developed for 
these and other skills- related objectives cannot be directly trans- 
ferred to writing. On the other hand, writing process models (e.g.. 
Elbow, 1973; Graves, 1983; Calkins, 1983) have introduced means of 
using structured peer response groups, peer editing, and other ways 
of having students help one another formulate, draft, evaluate, and 
revise compositions. However, little methodologically adequate 
research has examined such writing process methods at the elementary 
level (see Caplan & Keech, 1980; Hillocks, 1984). 

Research £l£n 

The present research is intended to develop and evaluate a com-- 
prehensive cooperative learning model for the teaching of reading 
and writing in the upper elementary school grades (initially, grades 
3-4) . The first step in the overall plan is to develop a complex 
model based both on principles of cooperative learning and on 



state-of-the-art knowledge of effective practices in the teaching of 
reading and writing. After development and pilot testing, the sec- 
ond step is to evaluate the full model in a field experiment in com- 
parison to untreated control groups. If the full program is effec- 
tiver component analyses will then be conducted to isolate 
individual variables responsible for the overall effects. 

This strategy of developing comprehensive programs and then 
disassembling them in component analysesr rather than testing one 
variable at a time, is based on a theory that elements of classroom 
organization are multiplicatively related to student achievement 
(Slavin, 1984r 1986). To have measurable effects on achievement 
variables not specifically keyed to the objectives being taught 
(such as standardized tests), multiple elements may have to be 
addressed simultaneously. In research on reading comprehension, 
where many researchers have questioned whether treatment effects on 
standardized reading comprehension scales are even possible (Paris, 
Cross, & Lipson, 1984; Johnston, 1984) ^ the need to first establish 
treatment effects for a complex program and only then conduct compo- 
nent analyses seems especially great. For example, one of the few 
methodologically adequate, long-term studies which have found posi- 
tive effects on standardized reading measures used a complex, com- 
prehensive approach (Anderson, Evertson, & Brophy, 1979). 

The instructional intervention developed and evaluated in this 
program of research is called Cooperative Integrated Reading and 
Composition, or CIRC. This paper reports the results of the first 
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field experiment conducted to evaluate the achievement results of 
the full CIRC program. 

Program Rationale juuj OvervlCW 

The CIRC program consists of three principal elements: Basal-re- 
lated activities, direct instruction in reading comprehension, and 
integrated language arts/writing. In all these activities, students 
work in heterogeneous learning teams. All activities follow a regu- 
lar cycle that involves teacher presentation, team practice, peer 
pre-assessment, additional practice, and testing. The major compo- 
nents of the CIRC program and rationales for them are described 
below. 

• 

peadin9 Groups . Students are assigned t'o reading groups accord- 
ing to their reading level, as de'-armined by their teachers. 

Teams . Students are assigned to pairs (or triads) within their 
reading groups, and then the pairs are assigned to teams composed of 
partnerships from two reading groups. For example, a team might be 
composed of two students from the top reading group and two from the 
low group. Team members receive points based on their individual 
performances on all quizzes, compositions, and book reports, and 
these points are contributed to form a team score. Teams that meet 
an average criterion of 95% on all activities in a given week are 
designated "superteams" and receive attractive certificates; those 
which meet an average criterion of 90% are designated "greatteams" 
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and receive smaller certificates. As noted earlier, research on the 
use of heterogeneous teams which are rewarded on the basis of their 
members' learning has established the instt actional effectiveness of 
this abroach (Slavin, 1983a, b}« 

Bflsal^RcIflt^iS Activities^ students use their regular basal read- 
ers. Basal stories are introduced and discussed in teacher-led 
reading groups that meet for 20-30 minutes each day. During these 
groups, teachers set a purpose for reading, introduce new vocabu- 
lary, review old vocabulary, discuss the story after students had 
read it, and so on. Presentation methods for each segment of the 
lesson are structured.' For example, teachers are taugjit to use a 
vocabulary presentation procedure that requires a demonstration of 
understanding of word meaning by each individual, a review of meth- 
ods of work attack, and repetitive oral reading of vocabulary to 
achieve fluency. Story discussions are structured to emj^^asize such 
skills as making and supporting predictions and identifying the 
problem in a narrative. 

After stories are introduced, students are given a story packet, 

which lays out a series of activities for students to do in their 

teams when they are not working with the teacher in a reading group. 
The sequence of activities is as follows: 

a« JB^LUtB^ Reading , Students take turns reading the story aloud 
witb thei': partners, alternating readers after each paragraph. They 
^6, t;'ue same tstory twice, correcting one anothers* errors. 

'ifced reading has been found to contribute to decoding and to 
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comprehension of narratives (SamuelSr 1979) . Alsor the partner 
reading gives students a great deal of oral reading practice and 
enables the teacher to assess student performance (by listening in) 
without having to have students read alotid in a reading group, wast- 
ing the time of the other students in the group. 

b. £tSiJa izCAmmfiX ^ story BslSiS^ Slltins- Students are given 
questions related to each narrative story that emphasize the story 
grammar. Halfway through the story, they are instructed to stop 
reading and to identify the characters, the setting, and the problem 
in the story, and to predict how the problem will be resolved* At 
the end of the story, 'students respond to the story as a whole and 
write a few paragraphs on a topic related to the story (for example, 
they might be asked to write a different ending to the story) • 
Research on reading comprehension has indicated the importance of 
students' learning story grammars (Fitzgerald & Spiegel, 1983> 
Meyer, 1977; Stein & Glenn, 1977) and of making predictions based on 
partial information about stories (Palincsar & Brown, 1984). 

c. Words Out iifiud. Students are given a list of new or diffi- 
cult words used in the story which they have to be able to read cor- 
rectly in any order without hesitating or stumbling. Students prac- 
tice these word lists with their partners or other teammates until 
they can read them smoothly. This activity helps students gain 
automaticity in decoding critical words (Rosenshine & Stevens, 1985; 
Samuels, 1981) . 
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fi. Word Hfiflnlng. students are given a list of story words which 
are new to their speaking vocabularies and asked to look them up in 
a dictionary, paraphrase the definition, and write a sentence for 
each that shows the meaning of the word (i.e., "An octopus grabbed 
the swimmer with its eight long arms," not "I have an octOPttB.*) 

e. story £fij;£il. After reading the story and discussing it in 
their reading groups, students summarize the main points of the 
story to their partners. 

f. Spelling . Students pretest one another on a list of spelling 
words each week, and then work over the course of the week to help 
one another master the list. Students use a "disappearing list" 
strategy in which they make new lists of missed words after each 
assessment until the list disappears and they can go back to the 
full list, repeating the process as many times as \ecessary. 

Partner Checking . After students complete each of the activities 
listed above, their partners initial a form on the cover of the 
story packet indicating that they have completed and/or achieved 
criterion on that task. Students are given daily expectations as to 
the number of activities to be completed, but they can <ip at their 
own rate and complete the activities earlier if they wish, creating 
additional time for independent reading (see below) . 

Tests . At the end of three class periods, students are given a 
comprehension test on the story, asked to write meaningful sentences 
for each vocabulary word, and asked to read the word list aloud to 
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the teacher. Students are not permitted to help one another on 
these tests. The test scores and evaluations of the story related 
writing are major components of students' weekly team scores. 

JiiXfiCt Ipstruction in Reading Comprehension . One day each week, 
students receive direct instruction in reading comprehension skillB, 
particularly finding main ideas, based on a step-by-step curriculum 
designed for this purpose. After each lesson, students work on 
reading comprehension worksheets and games as a whole team, first 
gaining consensus on one set of worksheet items and then assessing 
one another and discussing any remaining problems on a second set of 
items. Recent research indicates that reading comprehension can be 
effectively taught as a skill separately from basal instruction 
(e.g., Palinscar & Brown, 1984; Paris, Lipson, & Wixson, 1983 j Stev- 
ens, 1985). 

Integrated lan guage sn^ Writing. During language arts peri- 

ods, teachers use a language arts/writing curriculum specifically 
developed for the project. In it, students work as teams on lan- 
guage arts skills which lead directly to writing activities. The 
emphasis of this curriculum is on writing, and language mechanics 
skills are introduced as specific aids to writing rather than as 
separate topics. For example, students study modifiers and then 
write descriptive paragraphs emphasizing their use, and study quota- 
tion marks before writing dialogue. On all writing assignments stu- 
dents draft compositions in consultation with peers, and then edit 
one anothers' work using peer editing forms emphasizing both the 
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content of the composition and its grammatical and mechanical cor- 
rectness. Students then revise their completed compositions on the 
basis of this peer feedback. The peer editing forms begin very sim- 
ply, but become increasingly complex as students cover successive 
skills. Writing process models using peer response groups and a 
sequence of planning, drafting, editing, and revision have been 
found to be effective in previous research (Hillocks, 1984), 
although little of this research has been done at the elementary 
level. 

Independent Reading . Students are asked to read a trade book of 
their choice for at least twenty minutes every evening. Parents 
initial forms indicating that students have read the required time, 
and students contribute points to their teams if they submit a com- 
pleted form each week. Students also complete at least one book 
report every two weeks, for which they also receive team points. 
Independent reading and book reports replace all other homework in 
reading and language arts. If students complete their story packets 
or other activities early, they can also read their independent 
reading books in class. 



Subjects ^ XI££lUb 



The subjects were 461 third- and fourth-grade students in 21 
classes in a suburban Maryland school district. The eleven experi- 
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mental classes in six schools were matched on California Achievement 
Test Total Reading scores with ten classes in four control schools. 
Experimental and control teachers volunteered to participate, with 
control teachers having an understanding that they would receive all 
materials and training in the fall following the conclusion of the 
study. The treatments were implemented over a 12-week period during 
the Spring semester, 1985. 

Treatments 

A. £smiJLSl» Control teachers continued to use their usual meth- 
ods and curriculum materials, which usually consisted of a three- 
reading-group model with workbooks during followup time and tradi- 
tional language arts/writing instruction given to the whole class. 

B. (!oopefative Integrated Reading ^ COIPPPSition • The 
CIRC program was implemented as described above. Teachers were 
trained in two three-hour sessions and were then visited by project 
staff (particularly in the early weeks ^of the program) who monitored 
program implementation and answered teachers' questions. 



Measures 

A. Achievement Pretests . To adjust for students' initial per- 
formance levels, standardized test scores from district records were 
used as covariates in all analyses. The scores used were Total 
Reading and Total Language scale scores from the California Achieve- 
ment Test. These were administered during the Pall of grade 3; thus 
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third graders' pretests were recent, but fourth graders' were a year 
old. The pretest scores were transformed to z-scores separately for 
each grade so that data from both grades could be combined. Also, 
writing samples administered at the start of the experiment were 
used as covariates in addition to Total Reading and Total Language 
in all analyses of writing posttests. 

B. Standardized Ppsttests . At the end of the experiment, all 
students were administered the Reading Comprehension, Reading Voca- 
bulary, Spelling, Language Expression, and Language Mechanics scales 
of the California Achievement Test, Form D. Third graders took 
Level 14 and fourth graders took Level 15. Raw scores from these 
scales were transformed to z-scores separately for each grade to 
enable combining scores across grades. 

C. Writing gamples . At pre- and posttesting, students were 
asked to complete a writing sample in response to probes designed to 
give them a specific audience and purpose for writing. The probes 
used were adapted from those developed and field tested for the 
California State Department of Education by a panel of writing 
experts led by Doris Prater of the University of Houston. The pre- 
and post-test probes are presented below. 

pretest £ifi>l2fi: 

IMAGINE nils. Your teacher has decided to have the class take a 
field trip this spring. Your teacher has asked all of the stu- 
dents in the class to make suggestions about where to go on the 
trip. Select a place that you think your class would like to 
visit for a day. Write a note to your teacher. Give the name of 
the place you have picked. Tell the reasons you think it is a 
good place for a field trip. 
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Pofittest li£j2£: 

IMAGINE THIS. You have met a girl from China near your school. 
She speaks English, but she does not know anything about schools 
ill America. Tell her about your school building. Tell her how 
the building looks on the outside and inside. Tell her about 
your teacher and your classmates. 

The classroom teacher was asked to read the probes to the class 
to make sure that all students understood the task. 

The probes were scored using an analytic scoring procedure devel- 
oped as the probes were designed and f ield--tested. Analytic as 
opposed to holistic scoring procedures were used so that content and 
mechanics skills in writing could be separately assessed. Each sam- 
ple was scored on a scale from 1 to 3 on two content variables — 
ideas and organization — and on mechanics skills such as punctua-- 
ti on/capitalization, spelling, usage/word choice, and syntax. 
Scores on the mechanics skills were combined to form one scale. 

Pour raters, uninformed as to the purpose or design of the exper-- 
iment, scored pretest and posttest samples on each of these varia- 
bles. Because of the time-consuming nature of the scoring proce- 
dures, only one sample in four was scored, with the first, fifth, 
ninth, etc. students in alphabetical order in each class serving as 
a subsample for the writing analyses. Each writing sample was rated 
by two raters. After the individual ratings were made, the two 
raters conferred, discussing and resolving any differences. The 
agreed-upon scores formed the data. 
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Raters were individually trained in the use of the analytic scor- 
ing system until their scores matched established ratings for the 
training essays 95% of the time on each variable. Training took 
approximately three hours. Reliability of the ratings, calculated 
during the actual scoring of samples, ranged from 83% to 97% agree- 
ment, with a mean reliability of 94%. 

Analyses 

The data were analyzed in two ways. First, analyses of covari- 
ance were conducted using the individual student as the unit of 
analysis. For the standardized posttests. Total Reading and Total 
Language scores served as covariates in all analyses. For the writ- 
ing samples, the same scores were used as covariates in combination 
with the pretest for each respective posttest. 

Second, posttest scores adjusted for pretests were used in ran* 
dom-effects nested analyses of variance, which are essentially equi- 
valent to class-level analyses (Glass Su Stanley, 1970; Hopkins, 
1982) « The nested analyses tested the mean square for treatment 
against that for classes within treatments, with degrees of freedom 
associated with the number of classes, not the number of students. 
The nested analyses are conservative tests from which generaliza- 
tions to similar samples can be made, while results statistically 
significant only at the individual level cannot be generalized to 
other settings with as much confidence (see Slavin, 1983d). 
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Pretest Differences 

As noted earlier, experimental and control classes were initially 
matched on California Achievement Test Total Reading scores. No 
pretest differences were found on this variable. HcWever, indivldu-- 
al*-level analyses of variance revealed statistically significant 
pretest differences on Total Language (F-9«13r p<«003) and on the 
pretest writing samples for Mechanics (F«10.61r p<.002). Both of 
these differences favored the control group* 

standardized PgsttestS 

Individual- level analyses of covariance found statistically sig- 
nificant differences favoring the experimental group on four of the 
five standardized scales, Reading Comprehension (Fe9«54r p<*002)r 
Reading Vocabulary (F«8.65r p<.003) , Language Expression (F«13*25r 
p<.001) r and Spelling (Fs=l5*20, p<*001)« Results were in the same 
direction for Language Mechanics, but were not statistically signi- 
ficant (F==2.91r p<.089). Degrees of freedom for all individual- 
level analyses were one and 457. Nested (class-level) analyses also 
found statistically significant differences on the same four varia- 
bles* Degrees of freedom for the nested analyses were one and 19# 
These results are summarized in Table 1* 

Table 1 also presents estimated grade equivalent differences 
between experimental and control groups^ after adjustments for pre- 
tests. These estimates were derived using norms from technical bul- 
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letlns for the California Achievement Test. They show adjusted dif-- 
ferences of 34% to 71% of a grade equivalent for the statistically 
significant differences on standardized measures. 



Tables 1 and 2 Here 



Writiny ^SESSlSS 

Table 2 summarizes the treatment effects for the writing samples. 
Statistically significant differences favored the experimental group 
in Organization ratings (F=9.37r p<.003) , and these effects were . 
also significant in the nested analyses (F«6.29r p<.021). No dif- 
ferences were found for Mechanics, paralleling the results for the 
standardized Language Mechanics scales, or for Ideas ratings. 
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PiBCUSBion 

Overall, the results of the experiment supported the effective- 
ness of the CIRC program on all target objectives except language 
mechanics and writing ideas. .The failure to affect language mechan-* 
ics was not unanticipated, as the language arts component of the 
program placed a greater emphasis on writing organization and con** 
tent and language usage (assessed by the language expression scale) 
than on Isolated language mechanics skills. However, it is hoped 
that in longer applications of the program the weaving together of 
language mechanics and writing Instruction will lead to a more sub** 
stantial gain in mechanics skills, especially as expressed in writ** 
ing* Also, the possibi? xty exists that substantial pretest differ- 
ences in Total Language favoring the control group may explain the 
failure to find differences on this variable. 

Because the teachers in the experimental group were volunteers 
and were then matched with teachers in other schools, they may have 
differed in motivation to participate and might therefore have been 
better teachers. However, the control teachers were recruited in 
the same way as the experimental teachers and were offered the pro- 
gram training and materials the following Pall, so motivation to use 
a new program may be considered equivalent across the two groups. 
Still, studies using random assignment of teachers need to be con- 
ducted in the future. 

The difficulty in interpreting a study of a complex program is 
that any number of factors could account for program effects. In 




this studyf it is reasonable to ascribe the effects on spelling to 
the partner spelling practice. The Writing Organization and Lan- 
guage Expression effects can probably be attributed to the inte- 
grated language arts/writing component, but students also did a 
great deal of writing as part of their basal related activities, 
especially in the story related writing component. The effects on 
Reading Vocabulary and Heading Comprehension may be due to the 
basal- related activities (such as the teaching of story grammars, 
partner reading, and mastery-oriented story comprehension practice), 
to direct instruction in reading comprehension skills, or to the 
daily 20-minute independent reading assignment. Component analyses 
to be conducted in the next stages of this program of research will 
decompose the full program to better understand the origin of its 
effects. 

This study demonstrates that if state-of-the-art principles of 
classroom organization, motivation, and instruction are used in the 
context of a cooperative learning progcam, student achievement in 
reading and writing can be increased. In particular, the study dem- 
onstrates that standardized measures of such skills as reading com- 
prehension and reading vocabulary can be affected by treatments sim- 
ultaneously addressing student motivation, classroom management, 
curriculum, and metacognitive activities. Given the pessimism among 
many reading researchers that standardized reading test scores (as 
opposed to measures more closely related to the experimental treat- 
ments) can be measurably increased (Paris et al., 1984; Johnston, 
1984), these findings are particularly important. Indeed, the per- 
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vasiveness of the study outcomes on standardized measures not 
related in any way to the CIRC curriculum is surprising given the 
brevity of the intervention (12 weeks). This study indicates that 
cooperative learning can be used effectively in elementary reading 
and writing, but a long road lies ahead to refine the methods and to 
understand the separate effects of their component parts. 
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Table 1 



Means, Standard DeviationSf and Analyses: 
Standardized Achievement Measures 



CIRC. 



CONTROL 



PRETESTS* 

Total Reading 
Total Language 

N 



POSTTESTS* 

Reading Comprehension 
Reading Vocabulary 
Language Expression 
Language Mechanics 
Spelling 



N 



ADJUSTED POSTTESTS* 
Reading Comprehension 
Reading Vocabulary 
Language Expression 
Language Mechanics 
Spelling 



N 



.056 
.143 



,045 
,024 
,057 
.006 
.085 



(SD) 



( .941) 
( .943) 

225 



(SD) 



( .971) 
( .981) 
(1.007) 
(1.020) 
(1.029) 

225 



.053 
.136 



-.043 
-.024 
-.054 
.005 
-.081 



(1.051) 
(1.034) 



(1.025) 
(1.017) 
( .991) 
( .981) 
( .965) 



ANOVA' S 
(d.f.=l,459) 



F 

1.38 
9.13 



P< 
ns 
.003 



236 



ANCOVA' S 
(d.f. =1,457) 



F 
9.54 
8.65 

13.25 
2.91 

15.20 



P< 
.002 

.003 
.001 
.089 
.001 



236 



Nested (Class-Level) 
Analyses 













(d.f. 


=1,19) 












F 


P< 


.100 


( 


.699) 


-.095 


( .668) 


4.85 


.040 


.091 


( 


.665) 


-.087 


( .643) 


4.62 


.045 


.122 


( 


.702) 


-.116 


( .720) 


4.45 


.048 


.062 


( 


.803) 


-.059 


( .733) 


1.44 


ns 


.141 


( 


.788) 


-.135 


( .749) 


11.29 


.003 






225 






236 





ADJUSTED POSTTESTS IN GRADE EQUIVALENTS 

Reading Comprehension 5.67 5.26 

Reading Vocabulary 5.2 8 4.94 

Language Expression 6.25 5.69 

Language Mechanics 6.81 6.49 

Spelling 6.22 5.51 



Difference 
.41 
.34 
.56 
.32 
.71 



* Table entries are in z-scores. 
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Table 2 



Means, Standard DeviationSr and Analyses: 
Writing Samples 



CIRC 



CONTROL 





X 


(SD) 


X 


(SD) 


ANOVA'S 


PRETESTS 










F p< 


Total Reading 


-.058 


(.923) 


.058 


(1.068) 


<1 ns 


Total Language 


-.234 


(.920) 


.234 


(1.021) 


7.68 .007 


Organization 


1.773 


(.621) 


1.879 


( .614) 


<1 ns 


Ideas 


2.053 


(.534) 


2.114 


( .560) 


<1 ns 


Mechanics 


2.248 


(.562) 


2.540 


( .462) 


10.61 .002 


N 




66 






66 



POSTTESTS 
Organization 
Ideas 
Mechanics 



2.136 
2.000 
2.261 



(.742) 
(.702) 
(.495) 

66 



1.894 
1.932 
2.343 



(.6 82) 
(.679) 
(.468) 



ANCOVA' 6 
(d.f.»l,109) 



F 

9.37 
1.78 

<1 

66 



P< 
.003 
ns 
ns 



Nested (01 ass- Level) 
Analyses 
(d.f.=l,19) 



ADJUSTED POSTTESTS 










F 


P< 


Organization 


2.188 


(.681) 


1.842 


(.644) 


6.29 


.021 


Ideas 


2.038 


(.616) 


1.894 


(.654) 


<1 


ns 


Mechanics 


2.310 


(.436) 


2.294 


(.415) 


<1 


ns 



N 



66 



66 
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